Survey on Self Adaptive Semantic Focused Crawling Using Ontology Learning

The Internet today has become a vast storehouse for a scintillating amount of knowledge. It is an excellent source of information catering to the needs of people of varied interests. But this process of information retrieval does have its shortcomings too viz. heterogeneity, ubiquity and ambiguity. Thus a self-adaptive semantic focused crawler SASF crawler that addresses these issues and optimizes the process of information discovery and indexing of the searched information is proposed. This framework encompasses the concepts of semantic focused crawling and ontology learning that helps to maintain the performance of the crawler in spite of the variety in the Web environment. The innovation here is the unsupervised vocabulary-based ontology learning and a hybrid matching algorithm that matches semantically relevant concepts and metadata. Finally the performance of the crawler is evaluated based on various parameters. Index Terms Ontology learning, Semantic focused crawling, Hybrid matching algorithm, SASF crawler, Information